Version: v2.10.0

Setup Yeedu Control Plane

1. Credentials Setup
2. Download Yeedu Control Plane Files
3. Deploy Yeedu Services on Kubernetes
4. Configure Yeedu Control Plane Properties

1. Credentials Setup

Create two files for to store below mentioned credentials:

Cloud Credentials:
- Create cloud_credentials.json.
- Paste JSON credentials in the specified format.
Registry Credentials:
- Create docker_registry_credentials.json.
- Paste JSON credentials for your container registry.

Credential Format for Microsoft Azure

{
    "CLIENT_ID": "<client_id>",
    "TENANT_ID": "<tenant_id>",
    "CLIENT_SECRET": "<client_secret>",
    "SUBSCRIPTION_ID": "<subscription_id>",
    "STORAGE_ACCOUNT_NAME": "<storage_account_name>",
    "CONTAINER_NAME": "<container_account>"
}

note

Replace all placeholder values (e.g., <client_id>, <tenant_id>) with your actual credentials. Keep these files safe and secure, as they contain sensitive information.

2. Download Yeedu Control Plane Files

To initiate your Yeedu Control Plane Setup, download the essential scripts from the yeedu-runtime.

Open a terminal or command prompt.

Run the following command to download the Yeedu Runtime Setup Files :

azcopy copy <https://$storage_account_name.blob.core.windows.net/$container_name/yeedu/yeedu-runtime.tar> </local/path/to/local/storage >
tar -xzvf /local/path/to/local/storage/yeedu-runtime.tar

note

Reachout to Yeedu team to get the access to the ADLS2 Storage Account and container registry which have all the Yeedu tars and images.

Change the working directory to yeedu-runtime:
```
cd yeedu-runtime
```

3. Deploy Yeedu Services on Kubernetes

3.1. Provide execute permissions

After updating properties, go to the Yeedu Control Plane folder. Find yeedu-core-services.sh and setup-ingress.sh script. Grant execute permissions:

chmod +x yeedu-core-services.sh
chmod +x setup-ingress.sh

3.2. Authenticate to Kubernetes Cluster (Azure Kubernetes Service)

Authenticate to the Kubernetes Cluster using the Azure Cloud CLI and kubectl commands provided below.

az login --service-principal --username CLIENT_ID --password CLIENT_SECRET --tenant TENANT_ID
az aks get-credentials --resource-group RESOURCE_GROUP_NAME --name CLUSTER_NAME

Validate successful cluster authentication by running the command below:

kubectl config get-contexts

3.3. Update SSL Certificates

In the yeedu-runtime directory, find the ssl folder. Update yeedu.crt and yeedu.key with the your specific SSL certificate and SSL RSA key. These files are used by the Yeedu Ingress Controller in Kubernetes.

3.4. Create DNS Entries

Create DNS entries for the Ingress record in the Azure cloud environment. Ensure entries are created for all configured hostnames in the Ingress. Execute the following command:

az network dns record-set a add-record --resource-group RESOURCE_GROUP_NAME --zone-name YOUR_DNS_ZONE_NAME --record-set-name <dns> --ipv4-address <ip>

4. Configure Yeedu Control Plane Properties

After downloading the essential files, customize your Yeedu environment by adjusting key configuration settings. Update the following property files to reflect your specific infrastructure and cloud provider details.

4.1. Configuration Files

yeedu-connection.properties:
- This file connects Yeedu to essential services like Postgres, RabbitMQ, and Redis. Update connection parameters based on your service configurations, including database hostnames, usernames, and passwords.
yeedu-system-config.properties:
- This file manages cloud-based services such as Object Storage and Container Registry. Align settings with your chosen cloud provider and configurations for seamless integration.

note

Uncomment and provide input values for the properties specified in the files. Detailed explanations for each parameter are available in the respective property files.

4.2. Variables Reference

4.2.1. yeedu-connection.properties

Metadata DB

Variable	Description	Default Value	Required
YEEDU_DEPLOY_LOCAL_POSTGRES	Enable local Postgres deployment	true	Yes
YEEDU_PG_DB	Name of the Postgres database	yeedu	Yes
YEEDU_PG_USER	Username for Postgres connection	postgres	Yes
YEEDU_PG_PASSWORD	Password for Postgres user	postgres	Yes
YEEDU_PG_HOSTNAME	Hostname or IP address of the Postgres server	Endpoint Url of the service	Yes
YEEDU_PG_PORT	Port number for the Postgres server	5432	No
YEEDU_PG_SSL_ENABLED	Enable SSL encryption for Postgres connection	false	No

Messaging Service

Variable	Description	Default Value	Required
YEEDU_DEPLOY_LOCAL_RABBITMQ	Enable local RabbitMQ deployment	true	Yes
YEEDU_MQ_USER	Username for RabbitMQ connection	guest	Yes
YEEDU_MQ_PASSWORD	Password for RabbitMQ user	guest	Yes
YEEDU_MQ_PORT	Port number for RabbitMQ	5672	No
YEEDU_MQ_UI_PORT	Port number for RabbitMQ management UI	15672	No
YEEDU_MQ_UI_HOSTNAME	Hostname for RabbitMQ management UI	Endpoint Url of the service	Yes
YEEDU_MQ_HOSTNAME	Hostname or IP address of the RabbitMQ server	Endpoint Url of the service	Yes
YEEDU_MQ_VH	Virtual host for RabbitMQ	"/"	No
YEEDU_MQ_SSL_ENABLED	Enable SSL encryption for RabbitMQ connection	false	No

Redis Cache

Variable	Description	Default Value	Required
YEEDU_DEPLOY_LOCAL_REDIS	Enable local Redis deployment	true	Yes
YEEDU_REDIS_PASSWORD	Password for Redis	admin	No
YEEDU_REDIS_PORT	Port number for Redis	6379	No
YEEDU_REDIS_HOSTNAME	Hostname or IP address of the Redis server	Endpoint Url of the service	Yes
YEEDU_REDIS_SSL_ENABLED	Enable SSL encryption for Redis connection	false	No

LDAP Service

Variable	Description	Default Value	Required
YEEDU_DEPLOY_LOCAL_LDAP	Enable local LDAP deployment	true	Yes
YEEDU_AUTH_LDAP_ORGANISATION	LDAP organization name	yeedu	Yes
YEEDU_AUTH_LDAP_DOMAIN	LDAP domain	yeedu.com	Yes
YEEDU_AUTH_LDAP_ADMIN_PASSWORD	Password for LDAP administrator	Ndbk5Lgb	Yes
YEEDU_AUTH_LDAP_HOSTNAME	Hostname or IP address of the LDAP server	Endpoint Url of the service	Yes
YEEDU_AUTH_LDAP_PORT	Port number for LDAP server	389	No
YEEDU_AUTH_LDAP_BASE_DN	Base DN for LDAP	dc=yeedu,dc=com	Yes
YEEDU_AUTH_LDAP_BIND_DN	Bind DN for LDAP	cn=admin,dc=yeedu,dc=com	Yes
YEEDU_AUTH_LDAP_BIND_PASSWORD	Password for LDAP bind user	Ndbk5Lgb	Yes
YEEDU_AUTH_LDAP_SSL_ENABLED	Enable SSL encryption for LDAP connection	false	No
YEEDU_AUTH_LDAP_GROUP_SEARCH_FILTER	LDAP query filter used to search for groups	`<YOUR_LDAP_GROUP_SEARCH_FILTER>`	No
YEEDU_AUTH_LDAP_USER_SEARCH_FILTER	LDAP query filter used to search for users	`<YOUR_LDAP_USER_SEARCH_FILTER>`	No
YEEDU_AUTH_LDAP_USER_GROUPS_SEARCH_FILTER	Filter to retrieve all groups of which a user is a member	`<YOUR_LDAP_USER_GROUPS_SEARCH_FILTER>`	No

REST-API

Variable	Description	Default Value	Required
YEEDU_RESTAPI_PORT	Port number for REST API server	8080	No
YEEDU_RESTAPI_HOSTNAME	Hostname or IP address of REST API server	Endpoint Url of the service	Yes
YEEDU_SECRET_KEY	Secret key for authentication and encryption	yeedu	No
YEEDU_RESTAPI_LOG_LEVEL	Log level for REST API server (e.g., INFO, DEBUG)	INFO	No
YEEDU_RESTAPI_SSL_ENABLED	Enable SSL encryption for REST API connection	false	No
YEEDU_RESTAPI_REPLICA_COUNT	Number of replicas/instances for REST API server	1	No

History Server

Variable	Description	Default Value	Required
YEEDU_HISTORY_SERVER_WEB_PORT	Port number for History Server web interface	10000	No
YEEDU_HISTORY_SERVER_WEB_HOSTNAME	Hostname for History Server web interface	historyserver.yeedu	No
YEEDU_HISTORY_SERVER_WEB_SSL_ENABLED	To Enable/Disable History server on HTTPS	true	No

Monitor

Variable	Description	Default Value	Required
YEEDU_GRAFANA_HOSTNAME	Hostname or IP address of Grafana server	Endpoint Url of the service	Yes
YEEDU_GRAFANA_PORT	Port number for Grafana	3000	No
YEEDU_GRAFANA_USERNAME	Username for Grafana login	YSU0000	No
YEEDU_GRAFANA_PASSWORD	Password for Grafana login	YSU0000	No
YEEDU_GRAFANA_LDAP_USER_GROUP_CN	LDAP user group Common Name (CN) for Grafana	cn=yeedu-user,ou=groups,dc=yeedu,dc=com	No
YEEDU_GRAFANA_LDAP_USER_BASE_DN	LDAP user base DN for Grafana	ou=users,dc=yeedu,dc=com	No
YEEDU_GRAFANA_LDAP_GROUP_SEARCH_BASE_DN	LDAP group search base for Grafana	ou=groups,dc=yeedu,dc=com	No
YEEDU_GRAFANA_SSL_ENABLED	To Enable/Disable Grafana server on HTTPS	false	No

InfluxDB

Variable	Description	Default Value	Required
YEEDU_INFLUXDB_HOSTNAME	Hostname or IP address of InfluxDB server	Endpoint Url of the service	Yes
YEEDU_INFLUXDB_PORT	Port number for InfluxDB	8086	No
YEEDU_INFLUXDB_DB	Name of the InfluxDB database	influx	No
YEEDU_INFLUXDB_USERNAME	Username for InfluxDB login	admin	No
YEEDU_INFLUXDB_PASSWORD	Password for InfluxDB login	admin	No
YEEDU_INFLUXDB_TOKEN	The authentication token for InfluxDB	`<Your_InfluxDB_Token>`	No
YEEDU_INFLUXDB_ORGANISATION	Organization of InfluxDB	yeedu	No

Cache Proxy

Variable	Description	Default
YEEDU_CACHE_PROXY_HOSTNAME	Hostname for Cache Proxy	""
YEEDU_CACHE_PROXY_PORT	Port for Cache Proxy	8765
YEEDU_CACHE_PROXY_SSL_ENABLED	Enable SSL for Cache Proxy	true

Scheduler

Variable	Description	Default
YEEDU_SCHEDULER_HOSTNAME	Scheduler host	""
YEEDU_SCHEDULER_PORT	Scheduler port	8081
YEEDU_SCHEDULER_USERNAME	Scheduler username	airflow
YEEDU_SCHEDULER_PASSWORD	Scheduler password	airflow
YEEDU_SCHEDULER_SSL_ENABLED	Enable SSL for Scheduler	false
YEEDU_SCHEDULER_REPLICA_COUNT	Number of scheduler replicas	1

Assistant

Variable	Description	Default
YEEDU_ASSISTANT_HOSTNAME	Hostname of Yeedu Assistant	""
YEEDU_ASSISTANT_PORT	Assistant API port	8000
YEEDU_ASSISTANT_SSL_ENABLED	SSL toggle for Assistant	false
YEEDU_ASSISTANT_FASTAPI_PORT	FastAPI internal service port	8001
YEEDU_ASSISTANT_REDIS_NAMESPACE	Redis cache namespace for Assistant	yeedu_ai_assistant
YEEDU_ANTHROPIC_API_KEY	API key for Anthropic LLM integration	`<ANTHROPIC_API_KEY>`

Yeedu Functions

Variable	Description	Default
`YEEDU_FUNCTIONS_PROXY_HOSTNAME`	Hostname for Functions Proxy	""
`YEEDU_FUNCTIONS_SSL_ENABLED`	Enable SSL for Functions Proxy	false
`YEEDU_FUNCTIONS_SCHEDULER_PORT`	Scheduler port for Functions service	5171
`YEEDU_FUNCTIONS_PROXY_PORT`	Proxy port for Functions service	5172

4.2.2. yeedu-system-config.properties

Yeedu Version

Variable	Description	Value	Required
YEEDU_VERSION	Specifies the version of the Yeedu platform to be deployed.	`v2.10.0`	Yes

Deployment Parameters

Variable	Description	Default Value	Required
YEEDU_DEPLOYMENT_MODE	Deployment mode	docker	Yes

System Properties

Variable	Description	Default Value	Required
YEEDU_RUN_INIT_SERVICE	Runs the initialization service during deployment.	`true`	Yes
YEEDU_ENVIRONMENT	Specifies the deployment environment (dev, prod, staging, etc.).	`dev`	Yes
YEEDU_ENABLE_GRAFANA_MONTORING	Enables Grafana monitoring for system metrics.	`false`	No
YEEDU_DEPLOYMENT_LOG_LEVEL	Sets the log level for deployment (`debug`, `info`, `warn`, `error`).	`info`	No
YEEDU_ASSISTANT_ENABLED	Enables AssistantX features within the platform.	`false`	No
YEEDU_ENABLE_SCHEDULER	Enables the Yeedu Scheduler component.	`true`	Yes
YEEDU_CACHE_PROXY_ENABLED	Enables the Cache Proxy service.	`false`	No

System Object Storage Configuration

Variable	Description	Default Value	Required
YEEDU_SYSTEM_CLOUD_PROVIDER	Cloud provider for object storage	-	Yes
YEEDU_SYSTEM_PROJECT_ID	Project ID for object storage	-	Yes
YEEDU_SYSTEM_OBJECT_STORAGE	Object storage bucket or container name	-	Yes
YEEDU_SYSTEM_CLOUD_CREDENTIALS_FILE_PATH	File path to cloud provider credentials (JSON)	-	Yes
YEEDU_SYSTEM_OBJECT_STORAGE_ENCRYPTION_ENABLED	Enable object storage encryption	-	Yes
YEEDU_SYSTEM_SPARK_EVENTS_RETENTION_DAYS	Retention period for spark events	90	Yes
YEEDU_SYSTEM_NFS_HOSTNAME	Hostname of the NFS server	`<your-hostname>`	Yes
YEEDU_SYSTEM_NFS_MOUNT_TARGET	The mount path on the NFS server	`<your-mount-path>`	Yes

System Container Registry Configuration

Variable	Description	Default Value	Required
YEEDU_SYSTEM_DOCKER_REGISTRY_PROVIDER	Docker registry provider	-	Yes
YEEDU_SYSTEM_DOCKER_REGISTRY_URL	Docker registry URL	-	Yes
YEEDU_SYSTEM_DOCKER_REGISTRY_CREDENTIALS_FILE_PATH	File path to Docker registry credentials (JSON)	-	Yes

Kubernetes Parameters

Variable	Description	Default Value	Required
YEEDU_SYSTEM_KUBERNETES_NAMESPACE	Namespace for Kubernetes	yeedu	No
YEEDU_SYSTEM_KUBERNETES_STATIC_IP	Static IP address for NGINX in Kubernetes	10.128.15.238	No

note

"Required" indicates whether the variable is required for Yeedu setup

4.3. Setup Ingress in Provided Namespace

Run the following command to setup Nginx Ingress Controller:

Execute the setup ingress script ./setup-ingress.sh, it will deploy the ingress.

After the ingress is created, obtain the IP address:

kubectl get ingress -n $YEEDU_SYSTEM_KUBERNETES_NAMESPACE

4.4. Deploy Yeedu Control Plane on Kubernetes

Execute the Yeedu Control Plane setup script yeedu-core-services.sh. Run ./yeedu-core-services.sh --help for more information. This script installs kubectl, Helm, Helmfile CLI, psql, rabbitmqadmin, and Redis CLI's on the machine, adapting to the machine's architecture and OS and setup up Yeedu Control Plane on Kubernetes.

Run the following command to start the Yeedu Control Plane on Kubernetes:

Start the services

./yeedu-core-services.sh start

Stop the services

./yeedu-core-services.sh stop

Restart the services

./yeedu-core-services.sh restart

Clean the services and delete data

./yeedu-core-services.sh clean

After executing these commands, the script generates necessary secrets, configmaps, deployments, pods, and services to run Yeedu Services on Kubernetes. Access the Yeedu RestAPI at the configured YEEDU_RESTAPI_HOSTNAME URL with HTTPS TLS termination provided by the ingress.

Below is the output when we run the Yeedu Control Plane setup script

📝 Log file is available at: /home/ma0804/.yeedu/deployment/logs/deploy_2024-02-16-14-44-30.log


    
    ██╗░░░██╗███████╗███████╗██████╗░██╗░░░██╗░░░██╗░█████╗░
    ╚██╗░██╔╝██╔════╝██╔════╝██╔══██╗██║░░░██║░░░██║██╔══██╗
    ░╚████╔╝░█████╗░░█████╗░░██║░░██║██║░░░██║░░░██║██║░░██║
    ░░╚██╔╝░░██╔══╝░░██╔══╝░░██║░░██║██║░░░██║░░░██║██║░░██║
    ░░░██║░░░███████╗███████╗██████╔╝╚██████╔╝██╗██║╚█████╔╝
    ░░░╚═╝░░░╚══════╝╚══════╝╚═════╝░░╚═════╝░╚═╝╚═╝░╚════╝░
    
🚀 This script is used to setup Yeedu core services. With this, we will be deploying the following Yeedu services:
  * yeedu-init - Initializes confs and Cloud-Formation-Engine
  * yeedu-metadata-db - PostgreSQL container which stores metadata of Yeedu
  * yeedu-restful-api - RestAPI which will act as an interface
  * yeedu-rabbitmq3 - RabbitMQ to stream messages in queues
  * yeedu-reactors-cosi - Reactors to start and stop workflow jobs
  * yeedu-reactors-monitor - Monitor workflows
  * yeedu-spark-history-server - Spark History Server
  * yeedu-spark-history-server-web - Nginx on history server
  * yeedu-redis - Redis Cache for Auth service
  * yeedu-ldap - LDAP used for authorization
  * yeedu-reactors-logs-collector - Container to sync reactor logs with bucket
  * yeedu-telegraf - Container to export machine metrics
  * yeedu-influxdb - InfluxDB to store all machine metrics
  * yeedu-grafana - Dashboards created for every machine on metrics

🚀 Setting up prerequisites...
🐳 Docker version:
	Docker version 25.0.3, build 4debf41
🐳 docker-compose version:
	docker-compose version 1.29.2, build 5becea4c
⌨️ Kubectl Version:
	Client Version: v1.28.2
⎈ Helm Version:
	v3.12.3+g3a31588
🌀 Helmfile Version:
	v0.144.0
✨ envsubst version:
	envsubst (GNU gettext-runtime) 0.19.8.1
🌈 jq version:
	jq-1.6
🐘 psql version: 
	psql (PostgreSQL) 16.2 (Ubuntu 16.2-1.pgdg20.04+1)
💾 redis cli version: 
	redis-cli 7.0.0 (git:35c054a8)
🐇 rabbitmq server version: 
	3.8.2-0ubuntu1.5
✔️ Prerequisites setup completed.


🚀 Setting up Yeedu Variables
🔧 Creating .env file...
✔️ Successfully created .env file.
🌐 Sourcing .env file and yeedu-env.sh script...
✔️ Successfully sourced .env file and yeedu-env.sh script.
📝 Saving Yeedu environment variables in .env file...
✔️ Successfully saved Yeedu environment variables in .env file.
⚙️ Configuring deployment mode-specific settings...
📝 Generating Kubernetes values.yaml from template...
✔️ Successfully configured Kubernetes deployment mode.
✔️ Successfully set the docker-compose path.
🔍 Checking for config file "./.env"...
✔️ Config file ".env" exists.


🚀 Running on deployment mode: aks
✅ YEEDU_ENABLE_GRAFANA_MONTORING is set to true.
✅ YEEDU_ENABLE_SCHEDULER is set to true.
✅ YEEDU_RUN_INIT_SERVICE is set to true.
✅ YEEDU_DEPLOY_LOCAL_RABBITMQ is set to true.
✅ YEEDU_DEPLOY_LOCAL_REDIS is set to true.
✅ YEEDU_DEPLOY_LOCAL_LDAP is set to true.

🔧 Performing operation ./yeedu-core-services.sh in environment dev
🚀 Performing operation start on services  yeedu-rabbitmq3 yeedu-metadata-db yeedu-redis yeedu-ldap and yeedu-restful-api yeedu-api-gateway yeedu-reactors-cosi yeedu-reactors-monitor yeedu-spark-history-server yeedu-spark-history-server-web yeedu-reactors-logs-collector yeedu-vault yeedu-ui yeedu-telegraf yeedu-influxdb yeedu-grafana yeedu-airflow-webserver yeedu-airflow-scheduler yeedu-airflow-worker yeedu-airflow-triggerer yeedu-airflow-init flower yeedu-init
📦 Below are the versions being deployed:
🔹 YEEDU_LDAP_VERSION: 1.5.0
🔹 YEEDU_APACHE_SPARK_VERSION: 3.2.2
🔹 YEEDU_RABBIT_MQ_VERSION: 3-management
🔹 YEEDU_TELEGRAF_VERSION: 1.28.2
🔹 YEEDU_HISTORY_SERVER_WEB_VERSION: 1.0.0
🔹 YEEDU_CLI_VERSION: v4.5.4-rc2
🔹 YEEDU_METADATA_DB_VERSION: v2.6.2-rc32
🔹 YEEDU_CLOUD_FORMATION_ENGINE_VERSION: v2.5.15-rc3
🔹 YEEDU_GRAFANA_VERSION: 8.0.2
🔹 YEEDU_REACTIVE_ACTORS_VERSION: v4.9.9-rc5
🔹 YEEDU_RESTFUL_API_VERSION: v4.7.4-rc41
🔹 YEEDU_INFLUXDB_VERSION: 1.8-alpine
🔹 YEEDU_APACHE_SPARK_HISTORY_SERVER_VERSION: v3.2.2-history-server
🔹 YEEDU_UI_VERSION: v1.0.0-rc57
🔹 YEEDU_REDIS_VERSION: 6.0.16
🔹 YEEDU_VAULT_VERSION: test-10



🚀 Setting up in Kubernetes...
Validating Kubernetes Configuration..

🔍 Checking CPU cores...
💻 Required CPU cores: 16
💻 Actual CPU cores: 16
✅ CPU cores meet the requirement

🔍 Checking memory...
🧠 Required memory: 32864112 Ki
🧠 Actual memory: 65728236 Ki
✅ Memory meets the requirement

🚀 Starting Kubernetes deployments...
🔐 Creating Docker registry secret...
🚀 Using Azure credentials.
secret/yeedu-image-pull-secret created
✅ Docker registry secret created successfully.

configmap/yeedu-cloud-credential-json created
configmap/yeedu-docker-registry-credential-json created
configmap/yeedu-aws-retention-json created
configmap/yeedu-azure-retention-json created
configmap/yeedu-gcp-retention-json created
configmap/yeedu-ldap-files created
configmap/yeedu-rabbitmq-files created
configmap/yeedu-redis-files created
configmap/yeedu-grafana-config-files-influxdb created
configmap/yeedu-grafana-config-files-ldap created
configmap/yeedu-grafana-config-files-all created
configmap/yeedu-grafana-config-files-grafana-home-dashboard created
configmap/yeedu-grafana-config-files-ini created
configmap/yeedu-grafana-config-files created
configmap/yeedu-telegraf-config-files created
configmap/yeedu-vault-config-files created

Affected releases are:
  yeedu-init-third-party (charts) UPDATED
  yeedu-ldap (charts) UPDATED
  yeedu-metadata-db (charts) UPDATED
  yeedu-rabbitmq3 (external-charts/rabbitmq-cluster-operator) UPDATED
  yeedu-redis (external-charts/redis) UPDATED

Upgrading release=yeedu-init-third-party, chart=charts
Release "yeedu-init-third-party" does not exist. Installing it now.
NAME: yeedu-init-third-party
LAST DEPLOYED: Fri Feb 16 14:44:56 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-init-third-party
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:44:56

To learn more about the release, try:
  $ helm status yeedu-init-third-party
  $ helm get all yeedu-init-third-party

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name:  -n yeedu-demo

Listing releases matching ^yeedu-init-third-party$
yeedu-init-third-party	yeedu-demo	1       	2024-02-16 14:44:56.38635391 +0530 IST	deployed	yeedu-0.1.0	           

Upgrading release=yeedu-metadata-db, chart=charts
Upgrading release=yeedu-ldap, chart=charts
Upgrading release=yeedu-rabbitmq3, chart=external-charts/rabbitmq-cluster-operator
Upgrading release=yeedu-redis, chart=external-charts/redis
Release "yeedu-metadata-db" does not exist. Installing it now.
NAME: yeedu-metadata-db
LAST DEPLOYED: Fri Feb 16 14:45:02 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-metadata-db
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:45:02

To learn more about the release, try:
  $ helm status yeedu-metadata-db
  $ helm get all yeedu-metadata-db

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: yeedu-metadata-db -n yeedu-demo

Listing releases matching ^yeedu-metadata-db$
yeedu-metadata-db	yeedu-demo	1       	2024-02-16 14:45:02.955963265 +0530 IST	deployed	yeedu-0.1.0	           

Release "yeedu-ldap" does not exist. Installing it now.
NAME: yeedu-ldap
LAST DEPLOYED: Fri Feb 16 14:45:02 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-ldap
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:45:02

To learn more about the release, try:
  $ helm status yeedu-ldap
  $ helm get all yeedu-ldap

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: yeedu-ldap -n yeedu-demo

Listing releases matching ^yeedu-ldap$
yeedu-ldap	yeedu-demo	1       	2024-02-16 14:45:02.836906619 +0530 IST	deployed	yeedu-0.1.0	           

Release "yeedu-rabbitmq3" does not exist. Installing it now.
NAME: yeedu-rabbitmq3
LAST DEPLOYED: Fri Feb 16 14:45:04 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
CHART NAME: rabbitmq-cluster-operator
CHART VERSION: 3.10.7
APP VERSION: 2.6.0

** Please be patient while the chart is being deployed **

Watch the RabbitMQ Cluster Operator and RabbitMQ Messaging Topology Operator Deployment status using the command:

    kubectl get deploy -w --namespace yeedu-demo -l app.kubernetes.io/name=rabbitmq-cluster-operator,app.kubernetes.io/instance=yeedu-rabbitmq3

Listing releases matching ^yeedu-rabbitmq3$
yeedu-rabbitmq3	yeedu-demo	1       	2024-02-16 14:45:04.46965117 +0530 IST	deployed	rabbitmq-cluster-operator-3.10.7	2.6.0      

Release "yeedu-redis" does not exist. Installing it now.
NAME: yeedu-redis
LAST DEPLOYED: Fri Feb 16 14:45:03 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
CHART NAME: redis
CHART VERSION: 18.6.2
APP VERSION: 7.2.3

** Please be patient while the chart is being deployed **

Redis&reg; can be accessed on the following DNS names from within your cluster:

    yeedu-redis-master.yeedu-demo.svc.cluster.local for read/write operations (port 6379)
    yeedu-redis-replicas.yeedu-demo.svc.cluster.local for read-only operations (port 6379)



To get your password run:

    export REDIS_PASSWORD=$(kubectl get secret --namespace yeedu-demo yeedu-redis -o jsonpath="{.data.redis-password}" | base64 -d)

To connect to your Redis&reg; server:

1. Run a Redis&reg; pod that you can use as a client:

   kubectl run --namespace yeedu-demo redis-client --restart='Never'  --env REDIS_PASSWORD=$REDIS_PASSWORD  --image docker.io/bitnami/redis:7.2.3-debian-11-r2 --command -- sleep infinity

   Use the following command to attach to the pod:

   kubectl exec --tty -i redis-client \
   --namespace yeedu-demo -- bash

2. Connect using the Redis&reg; CLI:
   REDISCLI_AUTH="$REDIS_PASSWORD" redis-cli -h yeedu-redis-master
   REDISCLI_AUTH="$REDIS_PASSWORD" redis-cli -h yeedu-redis-replicas

To connect to your database from outside the cluster execute the following commands:

    kubectl port-forward --namespace yeedu-demo svc/yeedu-redis-master 6379:6379 &
    REDISCLI_AUTH="$REDIS_PASSWORD" redis-cli -h 127.0.0.1 -p 6379

Listing releases matching ^yeedu-redis$
yeedu-redis	yeedu-demo	1       	2024-02-16 14:45:03.024669353 +0530 IST	deployed	redis-18.6.2	7.2.3      


UPDATED RELEASES:
NAME                     CHART                                       VERSION
yeedu-init-third-party   charts                                             
yeedu-metadata-db        charts                                             
yeedu-ldap               charts                                             
yeedu-rabbitmq3          external-charts/rabbitmq-cluster-operator    3.10.7
yeedu-redis              external-charts/redis                        18.6.2


Validating PostgreSQL connection...
Checking if the database exists
Database yeedu exists on the PostgreSQL server 🐘.
✅ Connected to PostgreSQL server 🐘.

🔒 Validating Redis connection...
PONG
✅ Connected to Redis server 🔑.

Validating RabbitMQ connection...
✅ Connected to RabbitMQ server and virtual host / exists.

Affected releases are:
  yeedu-grafana (charts) UPDATED
  yeedu-history-server (charts) UPDATED
  yeedu-influxdb (charts) UPDATED
  yeedu-init (charts) UPDATED
  yeedu-reactors-cosi (charts) UPDATED
  yeedu-reactors-log-sync (charts) UPDATED
  yeedu-reactors-monitor (charts) UPDATED
  yeedu-restapi (charts) UPDATED
  yeedu-ui (charts) UPDATED
  yeedu-vault (charts) UPDATED

Upgrading release=yeedu-init, chart=charts
Release "yeedu-init" does not exist. Installing it now.
NAME: yeedu-init
LAST DEPLOYED: Fri Feb 16 14:48:12 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-init
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:48:12

To learn more about the release, try:
  $ helm status yeedu-init
  $ helm get all yeedu-init

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: init-yeedu -n yeedu-demo

Listing releases matching ^yeedu-init$
yeedu-init	yeedu-demo	1       	2024-02-16 14:48:12.163209325 +0530 IST	deployed	yeedu-0.1.0	           

Upgrading release=yeedu-reactors-cosi, chart=charts
Upgrading release=yeedu-influxdb, chart=charts
Upgrading release=yeedu-grafana, chart=charts
Upgrading release=yeedu-reactors-monitor, chart=charts
Upgrading release=yeedu-history-server, chart=charts
Upgrading release=yeedu-vault, chart=charts
Release "yeedu-reactors-monitor" does not exist. Installing it now.
NAME: yeedu-reactors-monitor
LAST DEPLOYED: Fri Feb 16 14:48:20 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-reactors-monitor
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:48:20

To learn more about the release, try:
  $ helm status yeedu-reactors-monitor
  $ helm get all yeedu-reactors-monitor

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: yeedu-reactors-monitor -n yeedu-demo

Listing releases matching ^yeedu-reactors-monitor$
Release "yeedu-grafana" does not exist. Installing it now.
NAME: yeedu-grafana
LAST DEPLOYED: Fri Feb 16 14:48:20 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-grafana
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:48:20

To learn more about the release, try:
  $ helm status yeedu-grafana
  $ helm get all yeedu-grafana

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: yeedu-grafana -n yeedu-demo

Listing releases matching ^yeedu-grafana$
yeedu-reactors-monitor	yeedu-demo	1       	2024-02-16 14:48:20.900815042 +0530 IST	deployed	yeedu-0.1.0	           

yeedu-grafana	yeedu-demo	1       	2024-02-16 14:48:20.804799253 +0530 IST	deployed	yeedu-0.1.0	           

Release "yeedu-reactors-cosi" does not exist. Installing it now.
NAME: yeedu-reactors-cosi
LAST DEPLOYED: Fri Feb 16 14:48:20 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-reactors-cosi
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:48:20

To learn more about the release, try:
  $ helm status yeedu-reactors-cosi
  $ helm get all yeedu-reactors-cosi

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: yeedu-reactors-cosi -n yeedu-demo

Listing releases matching ^yeedu-reactors-cosi$
yeedu-reactors-cosi	yeedu-demo	1       	2024-02-16 14:48:20.8960508 +0530 IST	deployed	yeedu-0.1.0	           

Release "yeedu-history-server" does not exist. Installing it now.
NAME: yeedu-history-server
LAST DEPLOYED: Fri Feb 16 14:48:20 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-history-server
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:48:20

To learn more about the release, try:
  $ helm status yeedu-history-server
  $ helm get all yeedu-history-server

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: yeedu-history-server -n yeedu-demo

Listing releases matching ^yeedu-history-server$
yeedu-history-server	yeedu-demo	1       	2024-02-16 14:48:20.773401496 +0530 IST	deployed	yeedu-0.1.0	           

Release "yeedu-influxdb" does not exist. Installing it now.
NAME: yeedu-influxdb
LAST DEPLOYED: Fri Feb 16 14:48:20 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-influxdb
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:48:20

To learn more about the release, try:
  $ helm status yeedu-influxdb
  $ helm get all yeedu-influxdb

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: yeedu-influxdb -n yeedu-demo

Listing releases matching ^yeedu-influxdb$
yeedu-influxdb	yeedu-demo	1       	2024-02-16 14:48:20.613711707 +0530 IST	deployed	yeedu-0.1.0	           

Release "yeedu-vault" does not exist. Installing it now.
NAME: yeedu-vault
LAST DEPLOYED: Fri Feb 16 14:48:20 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-vault
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:48:20

To learn more about the release, try:
  $ helm status yeedu-vault
  $ helm get all yeedu-vault

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: yeedu-vault -n yeedu-demo

Listing releases matching ^yeedu-vault$
yeedu-vault	yeedu-demo	1       	2024-02-16 14:48:20.749720578 +0530 IST	deployed	yeedu-0.1.0	           

Upgrading release=yeedu-restapi, chart=charts
Upgrading release=yeedu-reactors-log-sync, chart=charts
Release "yeedu-reactors-log-sync" does not exist. Installing it now.
NAME: yeedu-reactors-log-sync
LAST DEPLOYED: Fri Feb 16 14:49:33 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-reactors-log-sync
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:49:33

To learn more about the release, try:
  $ helm status yeedu-reactors-log-sync
  $ helm get all yeedu-reactors-log-sync

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: yeedu-reactors-logs-sync -n yeedu-demo

Listing releases matching ^yeedu-reactors-log-sync$
yeedu-reactors-log-sync	yeedu-demo	1       	2024-02-16 14:49:33.992926056 +0530 IST	deployed	yeedu-0.1.0	           

Release "yeedu-restapi" does not exist. Installing it now.
NAME: yeedu-restapi
LAST DEPLOYED: Fri Feb 16 14:49:33 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-restapi
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:49:33

To learn more about the release, try:
  $ helm status yeedu-restapi
  $ helm get all yeedu-restapi

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: yeedu-restapi -n yeedu-demo

Listing releases matching ^yeedu-restapi$
yeedu-restapi	yeedu-demo	1       	2024-02-16 14:49:33.988235087 +0530 IST	deployed	yeedu-0.1.0	           

Upgrading release=yeedu-ui, chart=charts
Release "yeedu-ui" does not exist. Installing it now.
NAME: yeedu-ui
LAST DEPLOYED: Fri Feb 16 14:50:16 2024
NAMESPACE: yeedu-demo
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Updated release : yeedu-ui
Release Namespace: yeedu-demo
Date Released: 2024-02-16 14:50:16

To learn more about the release, try:
  $ helm status yeedu-ui
  $ helm get all yeedu-ui

List the status of the Deployment using the command:
  $ kubectl get all -l app.kubernetes.io/component-name: yeedu-ui -n yeedu-demo

Listing releases matching ^yeedu-ui$
yeedu-ui	yeedu-demo	1       	2024-02-16 14:50:16.792648707 +0530 IST	deployed	yeedu-0.1.0	           


UPDATED RELEASES:
NAME                      CHART    VERSION
yeedu-init                charts          
yeedu-reactors-monitor    charts          
yeedu-grafana             charts          
yeedu-reactors-cosi       charts          
yeedu-history-server      charts          
yeedu-influxdb            charts          
yeedu-vault               charts          
yeedu-reactors-log-sync   charts          
yeedu-restapi             charts          
yeedu-ui                  charts          


🚀 Finished Setting up Yeedu...

📝 Log file is available at: /home/ma0804/.yeedu/deployment/logs/deploy_2024-02-16-14-44-30.log

1. Credentials Setup​

2. Download Yeedu Control Plane Files​

3. Deploy Yeedu Services on Kubernetes​

3.1. Provide execute permissions​

3.2. Authenticate to Kubernetes Cluster (Azure Kubernetes Service)​

3.3. Update SSL Certificates​

3.4. Create DNS Entries​

4. Configure Yeedu Control Plane Properties​

4.1. Configuration Files​

4.2. Variables Reference​

4.2.1. yeedu-connection.properties​

Metadata DB​

Messaging Service​

Redis Cache​

LDAP Service​

REST-API​

History Server​

Monitor​

InfluxDB​

Cache Proxy​

Scheduler​

Assistant​

Yeedu Functions​

4.2.2. yeedu-system-config.properties​

Yeedu Version​

Deployment Parameters​

System Properties​

System Object Storage Configuration​

System Container Registry Configuration​

Kubernetes Parameters​

4.3. Setup Ingress in Provided Namespace​

4.4. Deploy Yeedu Control Plane on Kubernetes​

1. Credentials Setup

2. Download Yeedu Control Plane Files

3. Deploy Yeedu Services on Kubernetes

3.1. Provide execute permissions

3.2. Authenticate to Kubernetes Cluster (Azure Kubernetes Service)

3.3. Update SSL Certificates

3.4. Create DNS Entries

4. Configure Yeedu Control Plane Properties

4.1. Configuration Files

4.2. Variables Reference

4.2.1. yeedu-connection.properties

Metadata DB

Messaging Service

Redis Cache

LDAP Service

REST-API

History Server

Monitor

InfluxDB

Cache Proxy

Scheduler

Assistant

Yeedu Functions

4.2.2. yeedu-system-config.properties

Yeedu Version

Deployment Parameters

System Properties

System Object Storage Configuration

System Container Registry Configuration

Kubernetes Parameters

4.3. Setup Ingress in Provided Namespace

4.4. Deploy Yeedu Control Plane on Kubernetes